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SUMMARY 



The New York Ci ty_£ubJLi.c. Schools' Promotional Gates- Program affects 
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daily operations in more than 600 schools in 32 community school dis- 
tricts. Despite its administrative complexity, the Gates program was 
fully operational and productive by, the time of the January test, just 
74 school- days after its inception. 

Some schools required three to six weeks to make the Gates program . 
fully operational because of class registration and materials problems. 
Predictably, these problems were more acute in junior high schools than 
in elementary schools.- Because it is an innovative approach providinq 
basic skills- instruction in self-contained' classes, the Gates program 
is prompting organizational and responsibility changes in iunior hiqh 
schools. ** • 

Seventy-two percent of all Gates program' teachers attended summer 
training sessions. Their enthusiastic reaction to that training in- 
forms both their classroom behavior and their opinions about the cur- 
rent program. 

i — • 

Early student achievement measures probably underestimate the 
program's potential impact, but in January," 1 982, 1,769 holdovers 
scored above mid-year promotional criteria, which were higher than end- \ 
of-year criteria. An additional 3,693 holdovers scored above end-of- 
year promotional criteria. Fourth-grade and seventh-grade holdovers 
who took the January California Achievement. Test .(and -whose April , 1981 ' 
scores were available) made observed mean gains of six months and'nine 
months, respectively. Regular education students, special education 
students, and limited English proficient students made comparable gains. 
Gams were similar among students in all Gates instructional programs. 
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I. INTRODUCTION 

The New York City Public School's promotional policy for kinder- 
garten through grade nine students (Chancellor's Regulation A-501) was 
promulgated June 30, 1980; the Promotional Gates Program was implemented 
as part of this policy in all community school districts in September, ' 
1981. This is the third Gates program report* prepared by the Office 
of Educational Evaluation (O.E.E.). It is designed to provide policy 
• makers with: 1). an assessment of student achievement oh the California 
Achievement Test (CAT) and the Criterion Referenced English Syntax Test 
(CREST) administered in April and August, 1981 and January, 1982; 2) 
descriptive information about program implementation; and 3) analyses 
which may affect pending program design and funding decisions in the 
fiscal 1983 city budget. 

This early report probably underestimates the program's potential 
impact. The Gates program is a citywide effort which affects the daily 
operations of mere than 600 schools in all 32 community school districts. 
It began only 74 school days before the January, 1982 test administration 
and the classes were not fully operational at all sites for several of 
those days. Student achievement in this first semes.ter is lower than 
projected averages for future semesters. 



*The first report was "The Promotional Gates Program: An Analysis of 
Summer School Participation and= August, 1981 Test Scores" (October 
\ 9 , 8 1}* ^he second was "The Promotional Gates Program: An Assessment 
?aJ5 o T !? 1mng in .the Exemplary Programs, August, 1981" (January, 
1982). Both are avanl able from the Office of Educational Evaluation. 
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This report contains four additional sections. Section II, "Program 
'Blu:lcgr6!^^ points in the new promotional policy 

and summarizes events leading up to the Gates program. Section III, 
"Program Implementation, " describes program administration, staffing, 
and classroom and curriculum implementation. Section IV, "Analysis of 
January Test Results," discusses achievement rates for all Gates hold- 
overs, and provides a preliminary analysis of relationships between 
program components and student achievement. Finally, Section V, "Conclu- 
sions," summarizes major findings and indicates areas requiring future 
attention.. 



II. PROGRAM BACKGROUND 

PROMOTIONAL POLICY : > 

•Pnorip.tiohal policy performance standards require that students 
receive standardized achievement test scores of not more than one year 
(rfor grades one through six) or one and one-half (for grades seven and 
eight) below grade level in reading and two years below in mathematics* 
for promotion to the next grade. The central administration enforces- 
checkpbints or "gates" at. grades four and seven and requires that 
children held back in these two grades be given intensive instruction 
(15 and 8 periods a week in language arts and mathematics, respectively) 
in_speeial classes of between 15 and 20 students. Special education 
students are subject to these standards, individualized education plans 
permitting. Most of these students are ma inst reamed and in resource 
rooms; some from self-contained classes participate in the Gates pro- 
gram. Bilingual students with four or more years in an English-language 
school system who do not meet promotional criteria, and those who have 
been in a bilingual program for fewer than four years and are below 
grade-level criteria on an English as a second language, test, also parti- 
cipate in the Gates program. 

PROGRAM START-UP 

AIT fourth- and seventh-grade students, including mainstreamed 
special education students, were given the California Achievement Test 



♦Implementation- of performance standards for writing will begin in 
1982-83. Students who failed to meet the mathematics standard alone 
were not held, over in 1981-82, tut should be receiving supplemental 
remedial help-. " 



(CAT) Form D in April, 1981. Eligible bilingual students were given 
the Criterion Referenced English Syntax Test (CREST). Over 24,000 
students with grade equivalent scores lower than '3.7 in fourth-grade" 
and 6.2 in seventh-grade (or below CREST criteriakwere classified 
as holdovers. * Several hundred were granted individual exemptions by 
the Assistant Superintendent for Promotional Policy under specific pro- 
motional policy criteria. At the end of the 1980-81 school year, 23,509 
students were designated Gates holdovers on the basis^of t'he CAT. 

A six-week intensive remedial program v/as conducted that summer. 
Participation was optional, and all holdover students could retake the 
CAT in August. Of the 15,917 holdover students who chose to retest on 
tiie CAT, 5,999 students attained the promotional criteria and were pro- 
moted. 

In September, 17,510 holdover students were assigned to Gates classes 
taught by specially trained teachers using programs designated exemplary 
by the Division of Curriculum and Instruction. 

The Gates classes also contain some students who are not actually 
holdovers. If there were fewer than 15 Gates holdovers, principals 
could place current fourth- and seventh-graders who might be .held over * 
in June, 1982 in Gates classes, or they couid try to place holdovers 
in cluster schools. If the parents of holdovers refused this placement, 
the pupils were held over and placed in regular fourth- and seventh-, 
grade classes and received additional services. Non-holdovers in Gates 
classes and holdovers in regular classrooms' are identified as such in 
the analytic data base. 

4 
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III. PROMOTIONAL GATES PROGRAM IMPLEMENTATION - 

The citywide. Promotional Gates Program is centrally administered. 
Under the direction of the Deputy Chancellor for Instruction, the pro- 
gram is monitored by the Office of Promotional .Policy (O.P.P:). In- 
structional support services are provided by the Division of Curriculum 
Snd instruction. Community superintendents' are responsible for imple- 
menting the program in their districts-, principals are responsible for 
classes in their schools'. 

The.Assistant Superintendent for Promotional Policy, head of O.P.P., 
is responsible for program monitoring, policy interpretation", and stu- 
dent exemptions. His six assistants each visit 100 to-150 schools, 



r 



meeting school supervisors and di strict Gates "facilitators'' to review 

problems, interpret program guidelines, and check s/udent classroom 

i 

assignments. They also visit classrooms to determine materials' avail- 

/ 

ability and extent of program implementation, and/ to handle teachers' 
questions and concerns. Their site visit report*, provide critical in- 
formation to the assistant superintendent and the Office of Educational 
Evaluation (O.E.E.) on program implementation. 

Each community superintendent designated a district facilitator as 
primary contact and resource person.- Facilitators - usually experienced 
teachers assigned to the district office spend half their time on the 
Gates program, particularly staff development activities. In districts 
with fewer Gates classes, facilitators visit classrooms regularly. 
School supervisors have major responsibility within a school for ensur- 
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ing that Gates teacher selection, student placement, and class schedules 
conform to Gates guidelines. 

SELECTION OF EXEMPLARY/OPTIONAL PROGRAMS 

Before the Gates program started, the Division of Curriculum and 
Instruction identified four reading programs,* two writing programs,* 
and two mathematics programs as exemplary. These programs have been 
usali successful ly in a range of New. York City community school districts. 
They all have reproducible program materials, manageable staff develop- 
ment requirements, and endorsements from district administrators and 
instructional personnel; all are instructional ly appropriate for a broad 
range of urban settings. Optional programs selected by district super- 
intendents for community school district use should meet similar criteria. 
All reading 'programs are embedded in a total language arts curriculum 
designed by the Division of Curriculum and Instruction or district curri- 
-culum developers. 

The four reading programs — Exemplary Center for Reading Instruction 
(ECRI); High Intensity Learning System (HILS-II) ; Lpacninq to Read Through 
the Arts (L.R.A.); and Structured Teaching in the Area of Reading (STAR) -< 
were presented to school district superintendents for adoption. Four 
districts chose ECRI, fotir chose HILS-II, and two selected STAR for all 
Gates classes. Thirteen districts combined two or three programs, and 
eight districts received permission to implement optional, district- 
developed reading programs in Gates classes. One district combined 



*Writing programs were not mandated for the 1981-82 school year. 



L.R.A. with a district-developed curriculum (see Table 1). 

Two exemplary mathematics programs, Diagnostic Prescriptive Arith- 
metic (D.P.A.) and Re.al Math (R.M.), were presented to district super- 
intendents. Six districts selected D.P.A. and four selected R.M. for 
implementation in all Gates classes; 13 districts selected D.P.A. for 
some Gates classes and R.M. for others. Ten districts received per- 
mission to implement optional, district-developed mathematics programs 
(see Table 2). 

The Office of Bilingual Education developed a language arts curri- 
culum for bilingual Gates classes. Most bilingual classes are imple- 
menting this curriculum in conjunction with exemplary or district- 
developed reading and mathematics programs. 

See Appendix A for a brief description of each instructional program. 

SELECTION OF GATES TEACHERS 

Community superintendents asked principals to solicit applications 
from interested teachers; Gates instructors were selected from these 
whenever possible. Of the 1,138 teachers currently teaching ^tesy 
classes, 762 (67 percent) said they submitted an application. ^ThTs was 
true for more fourth-grade (74 percent) than seventh-grade teachers 
(61 percent). -Eligibility criteria are specified in the promotional 
policy as follows: 1) minimum three years' teaching, experience; 
2)" demonstrated effectiveness with below standard students; 3) willing- 
ness to meet with parents and encourage involvement; 4) familiarity 
with a range of teaching strategies appropriate for below standard 
students; 5) willingness to participate in staff development sessions 
before and during the school year. 
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TABLE 1 

Adoption of Reading Programs by Grade by District* 



District 


ECRI 
4th 7th 


HILS-II 
4th 7th 


LRA 
4th 7th 


STAR 
4th 7th 


Optional 
Reading 
4th. 7th 


1 


- 


X 




X X 




2 




X X 




X X 




*3 






X 


X X 




4 










X X - 


5 


X X 










6 




X X 


X 


X X 


- 


7 


X X 










8 


X 






X X 




9 


X X 


X 


*- 


X X 




10 










X X 


11. 








X X 


12 


1 

i 






X X 


13 _ 


X X 




* 






- 14 




X X 


X 


X 




. 15 _ 




X X 








16 










X X 


- i7:- 




- - - 


X X 




X X 






X X 




X 




19',, - 




' x\ . - X 


f — 






':. -20 _ 




. X X: 4 . 


- X X 


X X 




21 


X . X 










22 : 










X X 


23 




. -X . X ' 


* - — 






24 




X 




X X 




25 




- X. _ X 




X X 




26 






* 


X X 




27 








r x x 




28 


X j x- 


X 




X X 




29 










X X 


30 


X 


X X 


X 


X 




31 . » 










X X 


32 




X X 









♦As reported by the community school districts on the District Promotional 
Form, September 18, 1981. 
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TABLE 2 

Adoption of Mathematics Programs by Grade by Ci strict* 



District 


OPA 
4th 7th * 


RM 

"4th 7th 


Ootional Math 
4th 7th 


1 


X 


X X v 




2 


X X 


X X 




3 


X 


X . X 




4 






X X 


5 


X 


X 


1 


6 


X 


X 


X 


7 


X X 






8 




. X* X 




9 


X X 


XX 




10 


X 


X 




11 






X X 


12 






X X 


13 


X X 


X * 




14 






X X 


15 


X X 






16 ^ ^ 




X X 




17 






X X 


18 






X X 


19 




t x 




20. 


. X 


X X 




21 




X X 




22 


X X 






23 






X X 


24 * 


X X 






25 


X 


X X 




26 


x 


X 




27 


X X 






28 


x - X 


X X 




29 






X X 


30 


X 


X. X . 




31 


X X 






32 

★A/. ^ 






X X . 



Policy Form, September 18, 1981. 



TRAINING AND STAFF DEVELOPMENT 

Teachers' and supervisors received preliminary training for the 
Gates curricula. In July and August, 1981 r the. Division of Curriculum 
and Instruction conducted week-long training sessions in exemplary 
reading and mathematics programs. Districts which chose an optional 
reading and/or mathematics program also provided summer training. In 
addition, every district designed a school-year training 'program based 
on teachers 1 needs. 

Division of Curriculum ancj Instruction Pre-Seryice Training 

Gates instructional staff using exemplary curricula (1,583 
teachers, school supervisors, and facilitators) received 20 hours of 
training for each at Norman thomas High School "during July arid* August,- 
1981. F Many teachers (especially fourth-grade teachers) received two 
weeks of training, to teach both, reading and mathematics. Separate 
sessions were designed for school suparvisors. Elementary school 
supervisors attended for one week, splitting their time equally between 
reading and mathematics instruction; junior high school supervisors 
received three days of curriculum instruction in their specialty (read- 
ing or mathematics). 

Most participants were unfamiliar with these curricula. They were 
-trained by, New York City teachers who had taught the curricula; most 

^An additional 189 teachers attended training sessions in September, 
1981. Teachers who attended both reading and mathematics training 
are counted twice. - , 
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participants praised their instructors. But their evaluations expressed 
reservations about topic coverage.* Teachers in the STAR program 
thought there was too much emphasis on theoretical issues and not enough 
on day-to-day concerns. They requested additional assistance with 
lesson planning, teaching strategies, and materials selection. ECRI 
teachers thought training time- was insufficient to prepare them for 
implementing specific program techniques. Many "were distressed with 
"ECRI's "overly mechanistic" approach. HILS-II teachers were most sat- 
isfied, but 'many wanted exposure to a HILS-II demonstration classroom. 
..They also. "worried about time limitations for setting up HILS-II labs 
at the beginning -of -the school yeari L.R.A. teachers ware enthused by 
the curriculum's unusual approach, Lut were concerned, with the lack of 
prepared materials. - - - 

Participants' assessment of mathematics training was generally 
more positive. More felt.that 20 hours permitted adequate coverage of 
curricula, and a majority of both teachers (59 percent) and supervisors 
(70 percent) believed their programs) could be effective. Despite * 
this, only 47 percent of the teachers and 29 percent of the supervisors 
thought the., summer training sufficiently prepared them to use the cur- 
ricula.. This. perception was especially acute among teachers (usually 
fourth-grade) and supervisors responsible for implementing more chan 
one,new curriculum, and among those with teaching backgrounds not fully 
congruent with their new program responsibilities. 



♦Evaluation forms were obtained from 1,046 (83 percent) of the 
teachers and 289 (89 percent) of the 324 supervisors attending these 
sessions.' - 



District-Sponsored Pre-Service Training 

Fourteen districts selected optional programs for instruction in 
reading and/or mathematics, and the Division of Curriculum and Instruc 
tion offered planning assistance for training. All sessions were held 
within the district and conducted by district supervisory staff. - 
Al though they were supposed to be parallel to the exemplary program 
training sessions, some ,di strict sessions were shorter, but not less 
than seven hours* - ^ 

Most district programs were already in use, so many district 
trainees were famiii-ar witb.tjie^ Perhaps^for this reason, 

and because trainers were frequently district colleagues, district 
training evaluations were slightly more positive than the citywide 
evaluations. On 'the average, 52 percent of district trainees were 
satisfied that the time allotted gave them sufficient curriculum prep- 
aration. 

> 

Availability of Trained Staff 

Of theT.,259 teachers who trained during the summer and completed 
Teacher Information Farms, 908 (72 percent) are currently in the Gates 
program; These 9.08 comprise 72 percent of. the 1,21>7 current-Gates 
teachers. An additional 230 program teachers (18 percent) said they 
did not attend summer training .sessions. The 119 remaining Gates - 

! 

teachers have not submitted Teacher Information Forms. More fourth- 
than seventh-grade teachers attended pre-service training: 416 (82 . 
percent) of the 509 fourth-grade and 492 -(66 percent) of. the 748 

12 ' 
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seventh- grade teachers participated. Roughly similar proportions of 
reading (81 percent) and mathematics (77 percent) teachers participated 
in summer pre-service training. 

Not surprisingly, teachers in 30 (17 percent) of the 179 schools 
visited by O.P.P. assistants between September and December, 1981 asked 
for or needed training. In addition to areas? mentioned. at the close of 
summer training (and discussed below), teachers requested assistance 
with assessment, diagnostic procedures, and instructional planning. 

School -Year Training Programs 

Many summer participants requested school-year training- and sup- 
port -in specific areas. More than 130 reading teachers wanted help in 
assessing individual pupil progress and working .with parents. At 
least .85 teachers requested help with record keeping * developfsig-stu- 
dent test-taking, writing, reading skills in content areas, and per- 
sonalizing instruction according to* diagnosed needs. 

In September each district submittedva design for ongoing school 
year training. The Division of Curriculum and Instruction suggested 
two-hour monthly sessions, with voluntary, but s^congiy encouraged, -par- 
ticipation. Each Gates staff member. may be paid for 16 training hours. 
Fourth-grade teachers should attend at least -six hours of training in 
both reading and mathematics/ Junior high school teachers should 
receive all 16 hours in either- reading or mathematics. Most districts 
also encourage non-Gates personnel to attend training sessions without 
pay. Although some sessions are citywide or sponsored. jointly by 
neighboring districts, most are held within individual districts. 



Training program designs filed by- the districts indicate that by 
-the end of the 1981-82 school year, all teachers will have received 
.Gates training. But the programs may not be addressing all teachers* 
needs. For example, only 13 districts have planned sessions on 
parental involvement, although teachers identified this as a high 
training priority-. Each district is providing at least six hours of 
training on reading jtopics, but only 18 have, planned at least 16 hours 
of supplemental instruction for junior high school teachers. Eighteen 
districts are also offering at least six hours of supplemental mathe- 
matics training, but only five have provided 16 hours. 

Division of Curriculum and Instruction staff have conducted at 
16ast half of this training.. The division also provides a telephone 
"hot-line" for teachers and parents and a weekly radio program, 1 "Gates 
Update," in which experts present pertinent program information anct 
answer listeners 1 questions. 

CLASSROOM IMPLEMENTATION ISSUES 

.The; Office of Promotional Policy, which monitors the Gates pro- 
gram, is a major source of information about the program's, implementa- 
tion. * Given the scope and complexity of this new program, O.P.P. anti- 
cipated that problems would arise early in the school year. Wi'th a 
view toward timely identification and reiolution of these problems, 
O.P.P. sent assistants to 179 schools (28 percent of the 641 partici- 
pating schools) in 30 districts by December, 1981. Thirty of these 
schools were visited more than once. Priority was given to those sites 
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at which" difficulties were either expected or reported. Because the 
assistants' function was to pinpoint program implementation problems 
for early correction, their observations were hot entirely balanced, 
nor were they intended to be. O.E.E. will be conducting a more system- 
atic evaluation of program implementation in the spring. 

After reviewing the site visit reports and interviewing O.P.P. 
staff, the evaluation team delineated four types of problems which 
occurred at some schools during the first few months of the program's 
operation: delays in program initiation; lack of Gates instructional 
materials; scheduling difficulties; and problems in classroom manage- 
ment. 

Program Initiation | * 

i 

Teachers and O.P.P. assistants reported that it sometimes required 
from three to six weeks for Gates classes to become fully operational. 
Some delays .resulted from inappropriate placement, due to missing test 
scores or misinterpretation, of Gates policy on potential holdovers. 
Others stemmed from over- or under-enrollment, teacher shortage or 
turnover, or occasional inclusion of non-program students in the rela- 
tively small Gates classes when regular classroom teachers were absent 
and substitutes had not been obtained. Some schools were reluctant to 
create an additional Gates class because of expected attrition from the 
program. , — - - \ 

Availability of Materials \ 

The problem mobc frequently observed at Gates sites was missing 
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assessment or curriculum materials* Forty schools (22 percent of, 
those visited) did riot have a full complement of essentia? or supple- 
mental material's. Sonre teachers trained in the diagnostic-prescriptive 
approach were amcertairi how to proceed when assessment materials were 
mi ssing. 

Classroom Schedules 

Most classes were found to be fulfilling the Gates requirement of 
15 periods of language arts and eight periods of math instruction per 
week. In the more crowded junior high schools, principals were some- 
times unable to assign a Gates class its own room, to schedule every 
period in the same place, or to assign a single teacher to all 15 
periods of reading. 

Classroom Management 

Planning and record keeping are fundamental to the diagnostic- 
prescriptive approach. While most teachers have specified instructional 
objectives in their lesson plans and have maintained achievement pro- 
files for students, others have found' these tasks too burdensome, 

CLASSROOM OBSERVATIONS 

Despite the early problems observed at some Gates sites, the O.P.P. 
assistants reported that tffie exemplary reading programs were well 
implemented i a most classrooms by December, 198i. In order to, describe 
this level of implementation, the evaluation team asked administrators 
of each of the four exemplary programs to identify an example of effec- 
tive program implementation. A member of the evaluation team (experi- 



in classroom observations) visited the four identified classes 

> * 

durXrig December., 1981 . 

-At- each site,- the school supervisor was. highly supportive of the 
program and the/feacherr Each teacher was receiy j fl g,,ongoi ng training, 
and was implem^ng^e^xemp^frpwiram as- designed. Although each 
•classroom was distinctly different from- the other three, each reflected 
-.the-ynder^ng^stracture of the specific program, and a. sense of the 
^teacher's and students' security wi't'hin that structure. -In- each class- 
4^aOTf-Wo^tive--learnirig was taking place. 

|GRI-. To a greater extent than/other reading -approaches, ECRI 
demands that the teacher learn and become adept at a variety of specific 
teachfrig. behaviors. To be fully 'effective, the teacher must reach a 
high-level of proficiency and speed- in conducting ECRI lessons. The 
Gates teacher in this classroom. was still learning the ECRI approach;* 
although she followed ECRI protocols, her delivery of ECRI cuei was " 
relatively slow. She wa-s able to focus -only- on one group- at a time 
while the other students-worked independently. Consequently, the rich 
variety of pupil activity possible within the ECRI classroom was not 
observed. 

Nevertheless, both the teacher and the students were proud of the 
progress that was being made. The teacher used the prescribed ECRI 
directions and corrections and was encouraging and supportive in the • 
prescribed ECRI manner. The students responded individually or collec- 
tively as directed. Their responses demonstrated understanding of the 
lesson content and ease with ECRI methods. 
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HILS-II . The Gartes teacher in this class had prior experience 
With HICS-II .in a reading lab^and was implementing the approach fully 
and fluently. The school had supplemented the HILS-II materials sup- 
plied-by the program, so an extensive array of materials was available. 
The classroom was functionally arranged for group and individual work. 

Students worked on individual prescriptions while the teacher held 
gnerto-one conferences or instructed two or three ^students at a time. 
Most students were able to work independently and productively with 
little supervision.. Students seemed "phoiid "of their ability to carry 
out individual prescriptions and .were eager to demonstrate their pro- 
gress to the teacher. Only one student wa$ unable to maintain a desir- 
able level of participation without repeated prompting. 

L.R.A. An artist-teacher and a classroom teacher together had 
developed a stimulating environment by displaying children's art and 
writing as well as teacher-made materials. The classroom allowed for 
flexible grouping patterns. Students could work independently in 
centers for recreational and content-area reading, reading skills 
development, and creative writing. 

The classroom teacher remained in the room during the artist- 
teacher's lesson to observe and assist students. Students and teachers 
participated enthusiastically. Students read* with interest and appar- 
ent comprehension, materials prepared by both teachers which were based 
on class experiences, and which contained sophisticated concepts and 
vocabulary. 
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^JTAR. This veteran teacher had no prior experience- in STAR meth- 
„odo1ogy^but-appeared-to-be-comfortabre-^-t-h~r he approac h. The room 'T 
arrangement and displays and the activities of the class reflected 
STAR'S philosophy and methods. The lesson began with a review of STAR 
strategies in which all students took part; developmental lessons were 
then presented to smaller groups while other pupils worked independently 
on skill reinforcement exercises. 

Th the lesson, vocabulary and concepts were developed orally. 
_S.tudents were guided to make predictions about the plot of a story 
which they then read avidly. Students competed for an opportunity, to 
recount the story and to answer questions that called for reasoning. 
The interest and enthusiasm demonstrated in this classroom were 
remarkable. s> . j : 

SUMMARY 

It is clear that the Gates program is ^eing implemented through- 
out the system; undoubtedly, it is more successfully implemented at 
some sites than at others. A complex administrative organization is 
functioning and basic programmable elements are in place. Central 
offices with primary responsibility for organization and monitoring of 
the program, selection of instructional programs, and staff development 
have provided services and extended them on the basis of identified 
needs. Districts have exercised their responsibilities for selection 
of teachers and instructional programs., and for providing in-service 
training and day-to-day supervision of the -program. 
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Problems were expected in initiating this complex program. As 
"these problem areas have been identified, decisive actions have been 
.taken. The most frequently reported problems- have involved the estab- 
lishment of class registers, the availability of materials, classroom 
record keeping, and scheduling of classes in the junior high schools. 
The Gates program is having particular impact on junior high schools 
which have traditionally been organized around instruction in consent 
areas with students moving from class* to class. The Gates program, by 
providing basic skills instruction in self-contained classes, is caus- 
ing changes in school organization and rethinking of responsibilities. 

.Classroom observations confirm that teachers in classrooms are 
implementing Gates curricula as designed. When well implemented, these 
curricula are impressive indeed. Even with generally experienced 
teachers, "however, full implementation of these curricula, will take 
time. . 

The reaction of teachers in the program is generally favorable. 
Teachers who participated in summer training were enthusiastic about 
the qual.ity of the preparation they were given but insecure about their 
ability to implement the curricula. They were concerned about the 
degree of support they would receive during the year. InformaTlyr 
teachers have reported receiving this support. As one Gates teacher 
stated at a recently held citywide Gates conference,. "You really 
came through. This time you didn't let us down." : 
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IV. ANALYSIS OF JANUARY, 1982 TEST RESULTS 

This section ,of the report presents data from the January, 1982 
administration of the California Achievement Test (CAT)* and the 
Criterion Referenced' English Syntax Test (CREST). Test scores are 
analyzed in three ways. 

First, results are presented for the 12,079 holdovers who took 
the January CAT and for whom the Office of Educational Evaluation has 
valid test scores from either April or August, 1981." Results are also 
presented for Gates holdovers who- took the January CREST. At the 
outset it is important to note that 4,903 students "who took the January 
-CAT have been excluded from the analysis because either they have no 
April or August test score on record (3,624 students), or they have a 
recorded April or August test score which is above the promotional 
criteria (1,279 students). The disposition of the January CAT answer 
documents, .the results for students not included in the main analytic 
file, and the composition of the various analytic groupings are des- 
cribed in Appendix B. 

^ The second type of analysis looks at citywide gains in student 
achievement for 11,362 Gates holdovers with both April and January CAT 
scores, and 717 additional holdovers with both August and January (but 
not April) scores." 



*CAT Form D was given in January, 1982 and April , 1981- Forni C unc 
given in August, 1981. Throughout the testing sequence fourth ,nH 
seventh-grade holdovers took Levels 14 and* 17? respefc^Jely" 
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Finally,, a more detailed series of analyses are presented. Hold- 
overs 1 gains fn each exemplary program are discussed, as are the gains v 
of special education and limited English proficient Gates students. 
The relationships between attendance and achievement and between pre- 
test and post-test scores are also observed. 

► ► 

JANUARY CAT RESULTS 

The January, 1982 test was given to provide information 1) about- 
the progress of all Gates students, and 2) needed to help individual 
pupils achieve the end-of-year promotional standards. The test also 
provided Gates holdovers with an opportunity for mid-year promotion. 
However, the desire to reward outstanding achievement was tempered 
by the realization that students promoted mid-year would face a diffi- 
cult situation in their new grades. They would lack much of the 
subject-area content presented in the first semester of the fifth- or 
"eighth-grade and would encounter promotional criteria once again at 
the end of the school year. The' January promotional cut-offs were 
therefore 'set at higher levels than those^for April to ensure that 
holdovers promoted mid-year wduld be prepared to meet the new fifth- 
and' eighth-grade criteria at the end of the year. In January, a 
fourth-grade holdover had to achieve a grade equivalent of 4.5 for 
promotion to the fifth-grade; a seventh-grade holdover was required to 
achieve a grade equivalent of 7.1 for promotion to the eighth grade. 
The April criteria for holdovers in the Gates program are set at 3.7 
and 6.2. 
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C';i-f^ b ^"-?^ r ' e5 .. ?n ^ S J ^uary^CAT results for holdovers in terms of 
4^%^#^9^* n / , '^Hl- > 6H"ter1a. A total of 1,757 Gates holdovers 
-•'sbo>ed SbQye; January, ppo^i^bnaj^cut-pffs. This is a. .remarjrabTe 
> achievement lor. th^ individual 'students. It represents a "gain since 
April, i981 of ;at; least nine months, (for fourth-graders) and Vo'months 
(foA-seventh-qcaders 1 )..",. " k ' J. : '^^, : \ ' 

A greater ip'er.centaqe^ (18.5-perceht) 
.than- ^ouri^^Mie^p^^^.'^lp^enty'het thVJanuary cut-off. In 
part, this is dM^f^f^fij^Sh^eqiii ylTeh'^of-the iw> criteria. The 
fourth- and severftM*^ " 
forty-seventh percent! les, r^specti vely^ ' Oine'.woul d therefore expect 
more- seventh-graders .to meet, these-crfteria.* ; However, in tjerms Jg£,the- 
ApriT cut-offs, which' are set at substantially equiv&fent percentiles 
for both qrades, a greater -proportion, of . fourth-graders scored above 
the promotional criteria. ' 

In addition to those students who scored above the January promo- 
tional-criteria, 3,-67.2 Gates, holdovers scored above the end-of-year 
criteria. These students should meet the promotional criteria when 
tested again in April, 1982. A total of 5,429, or 45 percent, of all 
Gates holdovers scored above the April promotional criteria at mid- 
point in the program. Figures 1 to 3 show what has happened to the 
original June, 1981 cohort of 23,509 holdovers. 



*Even so, if the same percentile cut-off (i..e., either the forty-seventh 
or fifty-second) had been used for both grades, a slightly greater pro- 
portion of c^venth-grade holdovers would have met the' January promo- 
tional standard. p 
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TABL'E 3 



- / 



of Mid-year and April Promotional .Criteria 



_ Grade 



Number* of 
Holdovers 
with: January* 
Test Scores 



;rr Students Scoring 

January Above' January 

Promotional Criteria Promoti onal -Cri teri a 

G.E, - itUe # % — — 



April 
Promotional 
Criteria 
G.E. %tile 



Students- Scoring TotaUHoldovers 

.B^low January but Scoring Above April- " 

Above April Criteria Promotional Cr iteria 
■ * % I 



% a 



Four 
Seven 
Total , 



7,167 
12,079~ 



4.5 52 431 '8.8% 

- - 4? 1,326 : 18.5%. 



3.7 31 
6.2 34 



1,757 



14.5% 



1.955 39.8% 2,386 48.6% 



T,717 24.0% 
3,672 30.4% 



3,043 42.5% 
5,429 45.0% 
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FIGURE" 2 ~* ;;~ V.,*,-^^ 
January, 1982 Status of Original June, 1981 Seventh-Grade .Holdovers 
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FIGURE 3 
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aouary, 1982 -Status of Original June, ,1981 Fourth- and Seventh-Grade Holdover* 
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Table 4 shows January CAT scores distributed in relation to April 
promotional criteria. There are three months of instruction between 
the January and Arril, 1982 administrations of the CAT. There are 
1,767 holdovers (909 fourth-graders and 858 seventh-graders) already 
within three months of the April promotional criteria. On the other 
hand, 4,883 holdovers are more than three months below the April cut- 
offs. Of greatest concern are the 2,422 seventh-grade and 834 fourth- 
grade holdovers v/io remain more^than nine months below the April pro- 
motional criteria. Figures 4 and 5 show January CAT scores distributed 
for grades four and seven, respect ively. 

The number and percentage of holdovers scoring above January and 
April promotional criteria, by district, are presented in Appendix C, 
Tables C-l and C-2, respectively. These data should be interpreted 
cautiously. Inter-district comparisons are complicated by differences 
in the distribution of pre-test scores within each district. 

JANUARY CREST RESULTS 

The January, 1982* CREST administration produced 221 answer docu- 
ments. The Office of Promotional Policy matched 69 of these answer 
documents to previous (April or August, 1981) valid CREST scores. 
Table 5 displays CREST results for the 69 holdovers. Ten ( 1 5.4 per- 
cent) fourth-graders and two (25.0 percent) seventh-graders scored 
above the January promotional criteria. Comparable figures for April 
promotional criteria are 26 (42.6 percent) and raven (87.5 percent), 
respectively. 
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TABLE 4 



Distribution of January, 1981 CAT Scores 
in Relation to April Promotional Criteria 



Grade 
Four 



Seven 



Grade 

Equivalent* 



3.7 and above 
3.4 to 3.6 
3.0 to 3.3 
2.7 to 2.9 
below 2.7 



Percentile 
Rank** 



20 and above 



Holdovers 



14 to 18 

V 

9 to 12 
6 to 8 
below 6 



2,386 
909 

'783 
389 
445 



7,167 



%_ 

48.6% 
18.5 
15.9 
7.9 
9.1 







4,912 


100% 


6.2 and above 


24 and above 


3,043 


42.4% 


5.9 to 6.1 ^ 


21 to 23 


858 


12.0 


5.5 to 5.8 


i7 to 20 


844 " 


11.8 


5.2 to 5.4 


14 to 16 


408 


5.7 


below 5.2 


below 16 


2,014 


28.1 



100% 



*Scores are expressed as grade equivalent units Tho 
-ant is one year; months'are exSressedas Senilis o^Yuilit?' meaSUr6 " 

-Percentile ranks apply to the beginning of the fifth- and eighth-grades, 
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FIGURE 4 

Distribution of January, 1982 CAT Scores for Fourth-Grade Holdovers 
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FIGURE 5 
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Distribution of January, 1982 CAT Scores for Seventh-Grade Holdovers 
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TABLE 5 



January, 1982 CREST Results 



Grade 



Four 

Seven 

Total 



Number of Holdovers " 
with January and 
Pre-test CREST Scores 



61, 
_8 
69 



Students Scoring 
above January 
Promotional Criteria 



10 
.2 
12 



16.4% 
25.0% 
17.4% 



Students Scoring 
above April 
Promotional Criteria 
# %~~ 



26 



33 



42.6% 



87.5% 



47.8% 
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.'ANALYSIS OF STUDENT ACHIEVEMENT GAINS 

Citywide Gains from April to January 

The analysis of citywide student achievement gains for 11,362 
holdovers wh.o took both the April, 1981 and January, 1982 CAT, is " 
shown in Table 6. Fourth-' and seventh-grade holdovers achieved mean - 
gains of six and nine months, respectively: The mean gains achieved 
in both grades for each district are displayed in Appendix C, Table C-3. 

When students, such as Gates holdovers, are selected* for parti- 
cipation in : . a remedial program because they score 'below a cut-off 'On 
a standardized test, and the same test is used again to gauge the 
group's achievement in the program, that measurement- is subject to 
statistical error. Because-of this error, the group's mean ga.in will 
increase, regardless of instructional intervention. This well- 
documented 'tendency is referred to as "regression to the mean" or "the 
regression effect."* 

There are many ways to account for the regression effect in educa- 
tionai- program evaluation. In the end-of-year report on the Gates 
program, the gains of students in a comparison group, and the perform- 
ance of Gates holdovers 'in three districts on the Degrees of Reading ' 
Power Test, will be analyzed.. Both* of these approaches will allow 
a better understanding of the regression effect and more definitive 
statements about Gates program impact on student achievement'. 



*See "E.S.E.A. Title I Evaluation and Reporting System " PMC R^^rrh 
SessiS ReViS6d f " funL 
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TABtE 6 



Gains of Holdovers with April, 1981 
and January, 1982 CAT Scores 





Grade 


Number of 
Holdovers with 
Matched Scores* 


Mean 
Grade 

Equivalent** 


> 

Grade Four 






/ April, J981 


4;545 


3.0 


? January, 1982 


4,545 


3.6 


Mean Gain 


4,545 , , 
* 


'0.6- 


Grade Seven 






•April, 1981 


6,806 


5.0 


January, 1982 ■ 


6,806 


5.9 


Mean Gain 


6,806 


0.9 



*These are the 11,362 holdovers having both April, 1981 and January, 1982 
CAT scores. 



**ffean scores and gains are expressed in grade equivalent units* The unit 
of measurement is one year; months are expressed in tenths of a unit. 4 
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t For thismid-year report, there is only one methodology available 
for estimating the extent 'of the regression "effect. It is a statistical 
adjustment of Gates holdovers' pre-test (April, 1981) scores. The 
formula's application results in adjusted mean gains "of two months in 
the fourth- grade and four months in the seventh-grade. It estimates 
^that four and five months of the observed gains in the fourth- and 
seventh-grades, respectively, are actually attributable to the regres- 
sion effect.* , , 
' ' Due to particular aspects of testing" in the Gates program, this 
statistical adjustment may be as error-prone as calculating observed 
gains . Statistical adjustment of pre-test scores is based on a 
theoretical model which cannot account for the repeated (more than 
twice) testing, and promotion of holdovers' in the Gates program. The 
model is suited to a simple test-retest situations which all program 
participants are retested.. In the Gates program,"' 5,999 holdovers were 
promoted in August and were therefore not tested in January. The 
effect of August promotions- on the validity of the statistical adjust- 
ments not known; they may cause the adjustment to overestimate the 
regression effect. - r 

J ' 

However, even this most conservative methodology results in a 
commendable adjusted gain in the first semester .of program' implementa- 
tion. The true gain in student -achievement will be much clearer at 
the end of the school >ear, but the full program effect will not be 



*See Appendix D for a.discussion of the statistical adjustment of pre- 
test scores to account for regression to the mean. ' - 
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known until participants 1 progresses tracked through subsequent 
school years. 

Comparison of August CAT to January CAT 

Only 717 holdovers have both August and January CAT (but^hot April) 
scores. Gains 'for these holdovers are displayed in Table 7. The 
observed- gains ,a re five- and nine months in fourth- and seventh-grade, 
respectively. .An adjustment for regression cannot be performed because 
a cityvride test wasnot given in August, so a citywide mean for August 
i s not available. 

Gains of Holdovers Scoring Above and Below April. Criteria 

The differences in gains from April to January between those - 
students who- scored above the end-of-year promotional criteria and 
those who did not are presented in Table 8. Fourth-graders scoring 
below 3.7 in January had mean gains of two months, while those scoring 
3..7 or above had mean gains of 11 months. Similarly, seventh-grade 
holdovers who scored below 6.2 had mean gains of two months while 
those scoring 6.2 or above had mean gains of 18 months. This indicates 
that hqldovers who attained the end-of-year promotional criteria are 
making substantial progress; those who have not yet attained the end-' 
of-year standards are making much less progress. 

The distribution of pre-^est scores for holdovers achieving 
January and end-of-year promotional standards is presented in 
Appendix C, Tables C-5 and C-6. Although many of the high-achieving 
holdovers in January had pre-test scores close to the cut-off, many 
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TABLE 7 . 



Gains of Holdovers with August, 1981 and 
January, 1982 (but not April* 1-981) CAT Scores 



Grade 



Grade Four 
/August, 1981 
January, 1982 
Mean Gain 



Number of 
Holdovers with 
August; & January 
Scores* 



366 
366 
366 



Mean 
Grade 

Equivalent** 



3.0 

3;5 

0.5 



Grade Seven 
August, 1981 
January, 1982 
Mean Gain 



351 
351 
351 



4.9 
5.8 
0.9 



*These are the 717 holdovers who lack April, 1981 scores but have hoth 
August, 1981 and January, 1982 scores. th 

**!!5?-U™ rW and ga ! n - 3re ex P ressed in g^de equivalent units. The 
unit of measurement is one year; months, are expressed as tenths of a 
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TABLE 8 



.January, 1981 CAT Mean Gains of Holdovers Scoring Above and 
Below End-of-Year (April) Promotional Criteria 



Stud ents Scoring Above April Promotional Criteria in January 



-Grade 



Four 
Seven 



Number with 
ApriV and 
January Scores 



2,229 
2,894 



Mean April 
Grade Equivalent* 



3.1 
5.3 



Mean January 
Grade Equivalent* 



4.2 
7.1 



Mean 
Gain* 



' 1,1 
1.8 



Students Scoring Below Apri l Promotional Criteria in. January 



Grade 



Number with 
April and 
January Scores 



Mean April 
Grade Equivalent 



Four 
Seven 



2,316 
3,912 



2.9 
4.8 



Mean January 
Grade Equivalent 



3.1 
5.0 



Mean 
Gain 



0.2 
0.2 
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did not. . Specifically, half of the fourth-grade holdovers who scored 
above 3.7 in January had pre-test scores above 3.1; the remaining half 
\ had lower pre-test scores dispersed over a wide range. Similarly, of. I 

-the. seventh-grade holdovers who scored above 6.2 in January, 46 perce/t 
had pre-test scores above 5.7; the remaining 54, percent had lower pre- 
test scores dispersed oyer a wide range. 

The pre-test scores of holdovers scoring below the end^of-year 
criteria in January showed a more even distribution in both grades. 

s There is clearly variation in the amount of pre- to- post-test improve- 
ment shown, by holdovers scoring at low levels in January. 
. , Success in the Gates program is not just being achieved by hold- 
overs with high pre-test scores. The data show enough variation to 
indicate succesk among holdovers at" all pre-test score levels. 

. ANALYSIS OF PROGRAM VARIABLES ' ; 

Relations hip Between Attendance and Achievement 
, Attendance in the Gates .program is comparable to attendance in 
fourth- and seventh-grades, citywide., Fourth-grade Gates holdovers 
had an average attendance of 91 percent through January, the same as 
the citywide average for all fourth-graders in 1980-81. Seventh-grade 

-Gates holdovers had an average attendance of 84 pe.cent, one percent 
lower than the citywide average for seventh-graders in 1980-81. 

Gates holdovers in both grades attended classes regularly. The 

majority were absent no more than five days prior to the January test. 

Their attendance did not vary much among the di fferent exemplary 
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instructional programs, but seventh-graders attended less frequently 
than fourth-graders. There is a small positive correlation between 
the number of days attended and January test scores.* Since students 1 
performance. on the January test is also, correlated with April, 1981 
£est scores,** an analysis was conducted to isolate the effects of 
attendance from pre-test scores. The analysis suggests that attendance 
makes a contribution to January test performance which is distinct from 
that of pre-test score. t 

Instructional Program Gains 

Table 9 shows the mean. pre- and post-test performance of hold- 
overs in different instructional programs. tt In both grades and 
across all programs, holdovers showed positive improvement. The mean 
gains for fourth- and seventh-grade were six and nine months, respec- 
tively. Students in the "no program" category (i;e., those in schools 
which had too few holdovers to form a Gates class) receive individual 
remedial services. They are not a comparison group and their perform- 

*In fotirth-grade, r=.09 (p<.001); in seventh-grade, r r .12 (p<.001). 

**In fourth-grade, r=.05 (p=.001); in seventh-grade, r=.03 (p<.05). 

tin fourth-grade, pre-test beta a .22, (F=211.6) and attendance beta = 
.08 (F=31.5); in seventh-grade, pre-test beta = .31 (F=667.1) and 
attendance beta = .12 (F=94.8). 

ttTest results for District 17 are reported separately, under Learning 
to Read through the Arts, w^iich is embedded in a language arts 
cjrriculum developed by the district. 

*. 
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TABLE 9* 



Analysis of Gains of Holdovers in 
Each Reading Program 



i .Grade 


Reading 
Proqram 


Number of. Holdovers 
with April and 
January .Scores 


April 
Mean ' 
G.E.* 


January 

Mean^G.E.* 


t Four 


ECRI 
STAR 
LRA 

LRA -Dist. 17 
HILS II 
Optional 


728 
1,021 
134 
244 
1,179 
1,056 


2.9 
3.0 
2.9 
3.0 
3.0 
3.0 


3.5 
3.6 
3.5 
3.6 
3.7 
3.6 


( 


All Programs 


4,362 


3.0 


3.6 


} 


No Program** 


183 


3.0 


3.6 



Mean 
Gain* 



0.6 
0.6 
0.6 



0.6 



0.6 



Seven 


ECRI- 
STAR 
LRA 

LRA - Dist. 17 


998 
1,778 
31 
469 


5.1 

* S.'O 
4.9 
5.0 


5.9 
6.0 
5,5 
5.9 
5.8 
5.9 


0.8 
1.0 
0.6 
0.9 
0.8 
0.9 




HILS II 
Optional 


• 1,840 
1,590 


5.0 
5.0 




All Programs 


6,706 


5.0 


5.8 


0.8 




No Program** 


100 


5.0 


" 5.5 


0.5 



The unit of measurement is one year; 



*Hean scores and gains are expressed as grade equivalents 
months are expressed as tenths of a unit. 

^* ? No_ program" indicates schools in which there were too few holdovers to form a Gates class Hold- 
SdiJl ISrvicIs SSnHhl^ " ™* seventh ' 9rade 'laEeKTlut receive additional 



_a.nce, cannot be used to measure'the effectiveness of the instructional, 
programs. In the- end-of-year report, the achievnmeht of.a bona fide 
comparison group will be analysed, and only then will the relative 
effectiveness of the instructs onaLprograms be fully understood. 

Gains Hade by- Re'gular, Spectal , and LEP_;Holdovers 

Achievement gains made by regular education, special education 
and limited English proficient (LEP) holdovers are 'sho^frMTTable' 10. 
Hpldoyers in all three groups made gains. Y Special education (resource 
room) students achieved the greatest gains — eight and eleven months 

* 

in fourth- and .seventh-grade, respectively. However, the individual- 
ized education plans, of many resource room children require, that they, 
be tested under modified conditions. Although the extent or effect of 
these modifications on their test scores is unknown, their gains in 
the Gates program are impressive. 

Limited English proficient holdovers gained four and six months 
in fourth- and seventh-qrade, respectively. These gains are similar 
to those of regular education holdovers. 

Detailed information about the classroom placement and instruc- 
tional strategies for limited English proficient and resource room 
holdovers lVnot available at this time. The Office of Educational 
Evaluation will collect more complete information on these students 
in April . * 
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. ' TABLE 10 ■ > 

Achievement Gains for Regular, Special Education, and LEP Holdovers 



jGrade 



Regular Education Students 



"Special Education, Students ' 



•Number of- 
Holdovers 



"Mean ... 
G.E.* ; 



Number of 
Holdovers 



Mean - . 
G.E.* 



LEP Students ,* 

Number of . Meah ; , 
Holdovers '• • G.E"?*' 



Grade Four 4 
April, 1981 
January, 1982 
Mean Gain 



3,927 
3,927 
3,927 



3.0 
3.6 
0.6 



417 
417 
417 



2.9 
3.7 
0.8 



201 
201 
201 



2.9 
3.3 
0.4 



Grade Seven 
'April, 1981 
(January, 1982 
Mean Gain 



6,222 
6,222 
6,222 



5.0 
5.9 
0.9" 



271 
271 
271 



5.1 
•6.2 
l.f 



313 
313 
313 



IS^d^s'TeSCrf 8 ! uni?: ade equ1valents ' The unit ° f «asur«nt is one year; months are 



4.8 
5.4 
0.6 
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Relationship Between August Testing and Achievement Gains in January 

A total of 6,107 students tested irf January were also tested in * 
August.* There are slight differences in the performance of August 
test takers and non-August test takers, but only in, seventh- grade. 
Seventh-grade holdovers tested in August made a one-year %ahVgain 
from April to January, all of which occurred between August and January. 
Seventh-grade students not tested in August made a mean gain of seven 
months from April to January. In the fourth- grade, both groups of 
students made mean gains of six months. 



*The data base for this report does not allow a senaration of holdovers 
who attended the summer Gates program from those who did not, but • 
simply took the August test. The latter group accounted for Tess than 

t four percent of August test-takers. 
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V. CONCLUSIONS 

, PROGRAM IMPLEMENTATION 

• Compared to other system-wide New York City Public School program 
implementations, the Gates program'is proceeding smoothly and produc- 
tively. A remarkable degree of thought, talent", and effort is evident 
at all levels'of program participation. The program is having an impact 
on daiiy classroom and school operations, and students are learning. 
^ a Many inevitable educational and organizational problems - including 
^materials availability and class register difficulties - have been 
. solved, but some problems persist.^dministrative organization, pupil 
identification procedures, and teacher selection and training require 
further attention. 

Admi n,j st rati ve 0 rgan i zat i on 

Although the Gates program's administrative structure was mobilized 
quickly and effectively^ e were overlapping o*r unclear responsibility 
assignments at ^central , district, and school levels. For example, 
several ..cental ? offic|s4ave, sent independent, conflicting communications 
concerning the- same Sssue. 

. There is.cpnfusiojj. In the. districts regarding the roles of O.P.P. 
-assistants/d^strict facilitators, and school supervisors. O.P.P. 

assist.at.ts are qualified administers tnd supervisors, but they have 
, 'had to spend most of their tinfe^n- pr^am monitoring and resolving 
-class register difficulties 'J ^ ^r^fa^itaters'mai not be devoting 

adequate time to, the GAtes vrtS$fijf'A» «f compgtfng responsibilities. 



Finally, there is confusion in the schools regarding the relationship 
between district facilitators and school supervisors. 

Pupil Identification Procedures 

Identification and placement of Gates students continues to be 
troublesome, mostly because there was no central machinery for these 
operations until afte^ the first April, 1981 eligibility test. 

Identification of limited English proficient holdovers has been 
confusing because of inadequately defined and inconsistently applied 
definitions of who should take the CAT and who should take the CREST. 
Complicating this situation is the fact that pupil records frequently 
lack information about length of time in an English language school 
system. As a result of these'problems, placement of limited English 
proficient holdovers has been subject to considerable error. Of those 
.limited English proficient-holdovers originally tested with the CAT 
and the CREST in April, 1981, only one-third and one-half, respectively, 
were identified as such on the January, 1982 tests. 

Teacher Selection and Training 

Some Gates teachers have no experience teaching reading and/or mathe- 
matics, a problem more prevalent in junior high schools than in elemen- 
tary schools. Furthermore, some Gates teachers received no program 
training prior to teaching Gates classes. 

STUDENT ACHIEVEMENT 

Considering time lost resolving practical classroom implementation 
problems, student achievement in the initial period probably under- 
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estimates the program's potential impact. Even so, 1,769 holdovers 
(14.5 percent) scored above January promotional criteria, and 5,462 
holdovers (45 percent) scored above end-of-year criteria. Fourth- 
arid seventh-grade holdovers achieved mean gains of six months and 
nine months, respectively. Students across the whole spectrum of 
"pre-test scores are benefiting from the Gates program, and special 
education, limited English proficient, and regular education students 
are making comparable gains. Program attendance parallels citywide 
averages for all fourth- and seventh-graders, and at mid-year, pupil 
achievement in each of the instructional- programs is similar. 
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•* Appendix A 

" » - c 

' DESCRIPTION OF GATES CURRICULA . ' * ' 

EXEMPLARY READING PROGRAMS 

M A11 v 0f ,- t >?l exem f , ]? ry readin 9 Programs have been used successfully 
in New York City public schools, and as Title I remedial programs. In 
addition, ECRI, HILS-II and L.R.A. have been- val idated by the United 1 
States Department of Education . ' unuea 

Each program is based on a major, current learning theory. Each 

h^Vnll* 5 C UP k i b6h f i°[ S ^°' r ? evel °P ment and supportive teacher be- ' 
haviors. Verba.l and behavioral pupiT response is critical, as are 
teacher expertise and enthusiasm. 

Exemplary Center for Reading' Instruction 

Pi.vIJlVf 31 -!-" 9 " 3 ^ ? rtS curri 'culum'uses a multi-sensory approach, 
eliciting specific verbal responses through precise directions, cor- 
rections, , and praise (prompts) to maximize attention, retention, accu- 
racy, and comprehension. In. word recognition lessons, pupils hear and 
see words .(or word parts) 'and immediately say, spell , and write them? 
In comprehension . essons, teachers orally model tasks which student 
imitate and practice-. As students internalize response modes teachers 
Phase out prompts. .Building'on systematic past learning re ievJ? Suoils 
learn to app y strategies to new situations. Individual ?y t 
evaluate pupil performance. * ««.eijr ue^ub 

Teachers are trained to four proficiency levels: initial, intro- 
ductory, intermediate,. and .proficient. Proficiency is evaluated throuqh 
a combination of curriculum complexity and teaching efficiency (speed)? 

i ^ 

High Intensity Learning System 

This individualized, diagnostic-prescriptive approach to readina 
instruction assumes that learning results from time spent on- individually 
appropriate activities. Teachers are instructional managers who keep 
pupils focused on these activities. p 

The HILS-II management system provides sequences of instructional 
objectives and related materials drawn from a wide range of published 
reading programs. Teachers identify indiviuual pupil needs through 
diagnostic tests, ensure that pupils understand prescribed objectives 
provide personal support, observe pupil progress through individual ' 
mastery tests, and move them through the system. Pupils record their 
own progress. 
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^Teaching preparation focuses on learning management system details, 
"reviewing instructional materials, and becoming effi>-eht in classroom 
management practices. 



Lea rning to Read Throdgh t the Arts ~ 

This program uses both a diagnostic-prescriptive and an experiential 
language arts workshop approach to reading instruction; Pupils alternate 
between concrete (non-verbal) and abstract (Verbal) experiences. In arts 
workshops, pupils llsten'to instruction, develop concepts and vocabulary, 
engage in activities, verbalize about experiences, read, and record ob- 
servations about different activities. During da^srooto reading in- 
struction, teachers present directed reading-skill lessons designed to 
me 7 et needs' identified in individual diagnostic tests. Field trips to 
museums, resource centers^ libraries, and cultural -institutions are in- 
tegral to the curriculum. , # »' ... 

Classroom and artist-teacher: work in teams? sharing^lesson plans 
.and observing each others 1 lessons to coordinate instruction. Reading 
skills lessons are based on arts workshops." The curriculum is^developed ~ 
through classroom experiences; teacher training is ^individualized and 
s conducted on-site. 



Structured Teaching in the Area of Reading 

This curriculum uses a psycho! ingu-istic approach to reading in- 
struction, guiding pupils to use language cues efficiently for under- 
standing.. Growth in reading ability is considered a holistic process 
rather than the acquisition isolated discrete skills. Teachers are 
trained to distinguish between miscues made- by prof icient readers which 
retain the meaning of a passage, and miscues made by. inefficient readers 
which do not make sense. • • . , 

STAR stresses direct teaching of Semantic arid syntactic strategies 
for making sense of written materials. Teachers receive extensive 
examples of strategy lessons as well as examples of* listening compre- 
hension lessons, language experienced essons for non-readers, and 
teacher-directed comprehension t les-sons. Although selected published 
materials are particularly recommended for classroom use, teachers 
£ase directed comprehension lessons on a wide range of. materials. 



OPTIONAL READING PROGRAMS 

Nine districts implemented alternative reading .curricula in Gates 
classes; all provide on-going pupil assessment. One program is an 
adaptation of STAR; another is an adaptation of L.R.A. Two combine 



basal reader lessons with individual, skills development in a lab setting 

^JS^iml&lU^V^ ^ co r nct1on "fth daily instruct Jn 
9 " Four are e rimaril y diagnostic-prescriptive pro- 

g r alM s • r r 

LANGUAGE ARTS CURRICULUM FOR LIMITED ENGLISH PROFICIENT STUDENTS 

i-hp-n^o A ^ a S-^ ent , Th S ugh Enrichmen t Skills (GATES), developed by 
the Office of Bilingual Education, draws on bittngual pupils' strengths 
in their first language to develop skills in English. " GATES teachers 
use' the Language Assessment Management System to identify Individ al 
and class needs and .guide planning for instruction? The curridulum 

Z SoTInfl! n° Pment ° f ™^y ^d language structured 7cm re- . 
S nd language skills' integration. While relying heavily on 
-teacher-directed activities-, the approach also uses other organ za- * 
tional forms to meet the varied needs of bilingual pupils. 

EXEMPLARY MATHEMATICS PROGRAMS > 

Each of- the two exemplary mathematics curricula, Diagnostic-Pre- 
scnptive Arithmetic (D.P.A,) and Real Math .(R.M.) teaches basic 
arithmetic skills. They differ 'from ordinar) "back-tlbasics" curri- 
cula by stressing development of mathematical, thinking and providing 
activity^based instruction. D.P.A. and R.M. share several other fea 
ures: diagnostic tests for periodic, individual student aslessmen?" 

othfr ^° r , reCOr . d - n S Stud6nt progresSi and on gamefand 

Other activities which reinforce newly-acquired skills: 

thanXlTpV* reseffi , bles traditional programs more closely 

books I * n„ ; ; ZZ^V ! teach r s guid ? and stude "t text- 
dooks. D.P.A., on the other hand, can be used with any text selected 

by the school. R M. provides a wide range of materials to sudd Sent 

instruction; D.P.A. provides some of these materials as weY a ? s Z- 

hlttXu. S19nin9 deVel0ping a variet > of teacher-generated 

OPTIONAL MATHEMATICS PROGRAMS 

Ten districts implemented- optional mathematics programs (including 
^exclusively for seventh-grade classes). -All include criterion- 
referenced periodic assessment tests. Each program provides co»??ete 
dSXent Str6SS problem - solv1ng sk ^ " d arithmetic concept 
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Appendix B 

* 

DEFINITION OF THE ANALYTIC GROUPINGS' 
' • USED IN TH^ ANALYSIS OF STUDENT ACHIFVEMENT 

* 

The Office of Educational Evaluation received a computer file 'with 
January, 1982 CAT results from the Office of Student Information Ser- 
vices.. This file contained 18,276 records. These records, represent- 
ing istuHcnts' answer documents, were compared to O.E.E>'s Promotional 
Gates -Program class 1tst, which was the result of an October, 198Ldata 
collection. The January test filewas compared to the files for the 
April and August, 1981 CAT administrations. After combining all these 
files, 13,373 January answer documents matched either April or August 
CAT scores below the promotional criteria. This group of 13,373 stu- 
dents is the one whose performance is anal.yzed in this mid-year report. 

The complete-disposition of the 18,276 January answer, documents is 
presented in Table B-l. January test results' for .those students not 
included in the main body .of this report are displayed in Table B-2. 

Two groups of students were excluded from the ir?*n analytic file. 
Firt excluded are 1,171 students whose pre-test scores were above the 
promotional criteria; they achieved January CAT mean grade equivalents 

, of 3.5, and 6.4 in the fourth- and seventh-grade, respectively. As one 
would expect, these students' mean grade equivalents are substantially 
equivalent to or slightly higher than those of holdovers included in 

"the analytic file (3.6 and 5.9 for fourth- and seventh-grades* respec- 
tively). Tne second group excluded from the analytic file, 3,379 stu- 
dents without pre-test scores,, had January mean grade equivalents (3.3 
and 5.5 in the fourth- and sev^enth^grade, respectively) sl ightly below 
those of the students in the analytic file. 

There are four reasons for the large number (4,550) of students 
tested in\January who were either matched to pre-test scores above the 
cut-off or not matched at all. First, completion of the .nine-digit 
student identification number (the basis of O.E.E.'-s file matching 
procedure) on the test answer documents is subject to error.- Second, 
some students tested -in January are not holdovers, but receive remedial 
services in Gates clashes, as a preventative measure. These students 
are fourth- and seventh-traders for the first time this year. Third, 
some students barely passed the promotional examinations in August and 
were retained in Gates classes for reasons other than their test scores. 
Finally, some students were tested individually in the fall, 1982, but 
the central administration has no record of their test scores. 

Gates program eligibility status for all these students will be 
resolvec" by the year-end report. 
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TABLE B-l 



Disposition o'f Answer Documents 
From the January CAT 



Total unduplicated January answer documents * 18,276 

1. Number matched to valid pre-test scores 13,373 

2. Number matched to pre-: test scores which 

were above the promotional criteria 1,279 

X 

3. Number not matched to any pre-test score 4 3,624 

Total unduplicated January answer documents 18,276 



Group of. students with valid .pre-test scores 13,373 

L. Students tested in January a'nc| April 11,362 

Students tested in January and August 

(but not April) 1 717. 

3* Students absent from the January/test ^ 1,294 ' 

/ 

Total f / • 13,373 
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TABLE B-2 



Results ^ of the January CAT for " 
Students Not Included in the Analytic File 



^Students Matched To Pre-Test Scores Which Were Abnvo ThP Promotional Criteria 
'Grade 



Students Tested 
in January 



Mean 
G.E. 



Four 
Seven 
Total 



970 
201 
1,171 5 



3.5 
6. A 



Students Not Matched to Any Pre-Test Score 
Grade 



Students. Tested 
in January 



Mean 
G.E. 



Students Above 
January Cut-Off 



% 



95 
60 



9.8% 
30.0% 



155 



13.2% 



Students Above 
January Cut-Off 



Students Above 
April Cut-Off 



# 



441 
113 



% 



45.5% 
56.2% 



554 47.3% 



Students Above 
April Cut-Off 









§ 


% 


# 


% 


Four 


1,826 


3.3 ' 


122" 


6,7% 


647 


35.4% 


Seyen 


1,553 


5.5 


226 


14.6% 


530 


34.1% 


Total 


3,379 




348 


10.3% 


1,177 


34.8% 



ERIC 
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65 



57 



—J 



TABLE C-l 



January, 1982 CAT Results; Number and Percentage of Gates Holdovers 
Scoring Above the January promotional Criteria by District and by Grade 



Grade Four Grade Seven- Total (Grades 4 4 7)' 



Di Strict 


nunvcr v* 

Holdovers 
Te s ted 


Holdovers above 
January Criteria 
# % 


Numhpr of 

Holdovers 
Tested 


Holdovers above 
January Criteria 

#, * 


Number of 
Holdovers 
Tested 


Holdovers 
above 
January 
Criteria 
# % 


i 


127 


6 


4.7X 


196 


53 


27. OS 


323 


59 


18.3% 


2 


89 


14 




74 


2* 


29.7 


163 


36 


22.1 


3 


97 


'9 


9.3 


157 


44 


28.3 


254 


53 


20.9 


4 


53 


3 


5.7 


103 ' 


17 


16.5 


156 


20 


12.3 


5 


117 


28 


23.9 


195 


52 


26.7 


312 


80 

x 


25.6 


6 


243 


12 


4.9 


202 


31 


15.3 


445 


43 ' 


9.7 


7 


212 


20 


9.4 


340 


64 


18.8 


552 


84 


15.2 


8 


161 


10 


6.2 


357 


52 


14.6 


518 


62 


12.0 


9 


360 


5 


1.4 


470 


57 


12.1 


830 


62 


7.5 


10 


410 


39 


9.5 


533 


96 


18.0 


943 


135 


14.3 


11 


87 


' 9 


10.3 


163 


25 


15,3, 


250 


34 


13.6 


12 


172 


10 


5.8 


245 


40 


16.3 


417 


50 


12.0 


13 


153 


11 


7.2 


224 


31 


13.8 


377 


42 


11.1 


14 


165 


8 


4.8 


380 


62 


16.3 


545 


70 


12.8 


15 


195' 


31 


15.9 


214 


26 


12.1 


409 


57 


13.9 


16 


137 


6 


4.4 


169 


19 


11.2 


306 


25 


8.2 


17 


256 


19 


7.4 


478 


88 


18.4 


734 


107 


14.6 


18 


65 


6 


9.2 


149 


31 


20.8 


- 214 


37 


17.3 


19 


381 


37 


9.7 


406 


57 


14.0 


787 


S4 


11.9 


20 


C5 


14 


16.5 


226 


55 


24.3 „ 


311 


69 


22.2 


21 


104 . 


8 


7.7 


VQ 


30 . 


17.6 


274 


38 


13.9 


22 


103 


10 


9.7 


103 


30 


29.1 


206 


40 


19.4 


23 


145 


16 


11.0 


252 


70 


27.8 


397 


86 


21.7 


24 


107 


13 


12.1 " 


166 


25 


15.1 


2/3 


38 


13.9 


25 


24 


3 


12.5 


35 


10 


28.6 


59 


13 


22.0 


26 


11 


2 


18.2 


16 


3 


18.8 


27 


5 


18.5 


27 


237 


15 


6.3 


tit 


67 


24.6 


509 


82 


16.1 


28 


120 


12 


10.0 


123 


22 


17.9 


243 


34 


14.0 


29 


132 


19 


14.4 


182 


42 


23.1 


314 


61 


19.4 


30 


112 


16 


14.3 


116 


23 


19.8 


228 


39 


17.1 


31 


43 


4 


9.3 


171 


52 


30.4 


214 


56 


26.2 


32 


209 


16 


7.7 


276 


30 


10.9 


485 


46 


9.5 


IS 227 


0 






4 


0 


0.0 


4 


0 


0.0 


Ci ty- 

wide 

Total 


4,912 


431 


8.8« 


7,167 


1 .326 


18.52 


12,079 


1,757 


14. 5% 
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TABLE C-2 



January, 1982 CAT Results: Number and Percentage of Gates Holdovers 
Scoring Above the April Promotional Criteria- by District and by Grade 





Grade 


Four 




Grade Seven 




Total (Grades A 


Jt 71 


District 


Number of 
Holdovers 
Tested 


Holdovers ibove 
April Criterion 


Nuffber of Holdovers above 
Holdovers April Criterion 
Tested * % 


Nurcber of 
Holdovers 
Tested 


Holdovers 
above 
April 
Criteria 


1 


127 


58 


45. 7% 


i . I'D 


07 


47. 3. » 


323 


155 


48. OS 


2 


89 


62 


69. 7 


74 


"50 
JO 


CI A 


ie:> 


100 


61.3 


3 


97 


51 


52.6 


15.7 


J 


C/t 1 
34. 1 


254 


136 


53.5 


4 


?3 


16 


30.2 


in*? 


^M 


JO . 0 


156 


56 


35.9 


5 


117 


68 


58. 1 


1 7J 


Q7 
7/ 


**7. / 


312 


165 


52.9 


6 


243 


98 


40. 3 


POP 

CMC 


7ft 
/ o 


Jo.D 


445 


1 76 


39.6 


7 


212 


97 


45.8 


i4n 




44. 1 


552 


247 


44.7 


8 


161 


78 


4ft A 
4o. 4 


357 


1 C 7 


JO. 1 


518 


207 


40.0 


9 


360 


127 


35.3 


470 




7a Q 

J4. 7 


830 


291 


35.1 


10 


410 


184 


44.9 


533 


229 


ai n 


943 


41 3 


43.8 


11 


87 


39 


44.9 


163 


62 


**ft n 

Jo.U 


250 


101 


40.4 


12 


172 


76 


44.2 


245 


' 100 


4n ft 


417 


1 TC 

1 7o 


42.2 


13 


153 


64 


41.8 


224 


83 


17 1 
J/ . 1 


377 


1 AT 
14/ 


39.0 


14 


165 


73 


44.2 


380 


140 


ft 

JO . O • 


545 


O 1 *J 

c 1 3 


39. 1 


15 


195 


120 


61.5 


21* 


76 


J 3 . 3 


409 


IOC 

196 


•♦7.9 


16 *' 


137 


52 


38.0 


169 


63 


37. 3 


306 


1 10 


J/.O 


17 


256 


123 


48.0 


478 


213 


44 6 


734 


J Jo 


45.8 


18 


61 


42 


64.6 


149 


65 


43.6 


214 


MJ/ 


50.0 


19 


381 - 


201 


52.8 


406 


152 


37.4 


787 


Jo J 


44 .9 


20 


'85 


45 


52.9 


226 


107 


47 7 
**/ .J 


311 


1 Ot 


48.9 


21 


104 


52 


ju . \j 


170 


75 


44.1 


274 


1 97 


Ad A 


22 


103 


64 


62.1 


103 


51 


49.5 


206 


115 


55.8 


23 


145 


75 


51.7 


252 


122 


48.4 


397 


197 


49.6 


24 


107 


57 


53.3 


166 


65 


39.2 


273 


122 


44.7 


25 


24 


14 


58.3 


35 


22 


62.9 


59 


36 


61.0 


26 


11 


7 


63.6 


16 


8 


50.0 


27 


15 


55.6 


27 


237 


130 


54.9 


272 


142 


52.2 


509 


272 


53.4 


28 


120 


59 


49.2 


.23 


54 


43.9 


243 


113 


46.5 


29 


132 


7? 


58.3 


182 


90 


49.5 


314 


167 


53.2 


30 


112 


59 


52.7 


116 


b2 


44.8 


228 


111 


48.7 


31 


43 


21 


48.8 


171 


<*9 


57.9 


214 


120 


56.1 


32 


209 


97 


46.4 


276 


94 


34.1 


485 


191 


39.4 


1.5. 227 








4 


1 


25.0 


4 


1 


25.0 


CUywide 
Total i 


J ,91 2 2,386 


48.65 


7.167 


3,043 


42.51 


12.079 5.429 


44.91 
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TABLE C-3 

Mean Gains of Fourths and SeventhrGrade Holdovers with 
April, 1981 and- January, 1982 CAT- Scores, by .District 



District 




Grade Four 






Grade 


Seven 


* Tested 


Mean Gain* 






* Tested 


Mean Gain* 


} 


ICO 


ft C 

U. 3 






195 


UO 


2 


OS 


" ft o 

0.9 






71 


0.8 


3 


on 


ft 'f ** 
0. / 






154 


1.4 


4 


3 c 








97 


0.7 * 


c 

3 


i in 


I.U 






185 


1.0 


5 




n a 

U. D 






198 


0.9 


7 


?na 


n c. 

U. 3 






329 


0.9 


3 


13/ 


u.o 






336 


0.8 


9 






r 




,443 


0.6 


10 


<N J 


U. 0 






CftC 

bub 


0. 9 


11 


78 


n 7 

• • u. / 






ICQ 


0, 9 


12 


166 


U. 3 








0. 6 


1 1 


ICO _ 


U. 3 


• 




loo 


0. 8 


Id 


KQ 


U, 3 






357 


0. 6 


15 


ISfi* 
1 3D 


0. 7 






1 Oft 


0. 4 


Ifi 

ID 


1 3Q 


U. 3 • 






164 


G. 7 . 


17 
i / 


* 7A1 * 


u. 0 






468 


0. 9 


1A 

1 o 


D 1 


0. 7, 






i 'in 
139 


i.o 


1Q 


33 J 


0. 8 






•50*5 

38Z 


0. 8 


70 


7A 
/O 


0. 9 






Z 14 


1.0 


21 


95 


ft 7 






ICC 
133 


0.6 


77 


_ QQ 


0. 7 






9/ 


1.3 


71 


^7^ 

icy 


ft 7 
U. / 






Z41 


1.2 


24 




0. 8 






ICC 

133 


0. 8 






n a 
U. o 






•3ft 

30 


1.4 


26 


• 11 


1.0 






14 


1.0. 


27 


211 


0. 8 » 






240 


1.3 


28 


113 


0. 6 






115 


0. 7 


29 


125 


0. 8 






181 


0.9 


30 


107 


0.8 






109 


0. 9 


31 


43 


0.5 






169 


1.1 


32 


191 


0.6 






274 


0. 7 


I.S.227 










4 


0. 5 



•Mean gains are expressed in grade equivalents. The unit of ueasurement is one year; 
withs are expressed as tenths of a unit. 
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"TABL 



Distribution of April, 1981 -CAT Pre-test Scores for Fourth-Grade 
Holdovers Scoring Above and Below End-of-Year Promotional Criteria 



Students Who Scored Above Students Who' Scored Below 

April Criteria April Criteria 



April G.E. 


*^ 1 


% 


April G.E. 


k N 


* % 


1.3 


4 


0.2 


1.3 


8 


0.3 


1.4 


3 


0.1 


1.4 


10 


0.4 


1.5 


1 


o.o 


l.b 


3 


0.L 


1.6 


6 


0.3 


< 1.6 


15 


6.6 


1.7 


9 


0.4 


1.7 


29 


1.3 


1.8 


18 


0.8 


1.8 


28 


1.2 


1.9 


45 


2.0 


1.9 


62 


- 2.7 


2.0 


1 


0.0 


2.0 


3 


0.1 


2.1 


43 


1.9 


2.1 


81 


3.5 


2.2 


57 


2.6 


2.2 


108 


4.7 


2.3 


2 


0.1 


2 3 


i 
i 


fi fi 


2.4 


85 


3.8 


2.4 


136 


5.9 


2.5 


102 


4.6 


2.5 


197 


8.5 


2.7 


155 


7.0 


2.7 


212 


9.1 


2.8 


169 


7.6 


2.8 


235 


10.1 


3.0 


210 


9.4 


3.0 


217 


9.4 


3.2 


243 


10.9 


3.2 


243 


10.5 


3.3 


256 


11.5 


3.3 


244 


10.5 


3.4 


306 


13.7 


3.4 


185 


8.0 


3.5 


291 


13.1 


3.5 


161 


6.9 


hi 


233 


10.0 


3.6 


138 


6.0 


TOTAL 


2,229 


100.0 


TOTAL 


2,316 


100.0 



, f 

^Scores are expressed in grade equivalents. The unit 
of measurement is one year; months are expressed as 
tenths of a jjnit. 
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. yW- fifty l .:: , :f^ ^^^:^F£'<£^. ^\ta 



>7/ V 



<{ tgf ft 

Dis,tr?fbutipit of Agrjl ,./198l A fAt/P|^-€est Scores' fpr Seventh -Graded I ^ </' a » 



7"' HdldjJVers Scoring ;Ab'ov.e'§nd: ; Be^ow r EndTb/-Year pVomotional Criteria- * >/ e^ 5 V 



Students«WHojScored^At , ov.e :- .->' ^ '; 



ft •" 



Ji f/ J ' 



-f9 







- ■ ' - -pry/ 


.April * l 


N ' 


A' ' 
' *« 




1 


.0.1 
0.0 




2 






2 






< 1 




- • ' 2.6 ^ 

^ ' /' 


#•/ 






^2 ,/' 


' ff.4 


. 3.3 w -' 




0.8 




- ' 42 ^ 


A 1.5 






' 1=8- 


' 3.9 






;-v4U - 








114 , 


/ 3.9'' 


/ ' ^ ^4.5 


138 * 


■4.8 


4.8 


"213 




5.0 ' 


233 


"8.0 . 


s.i 


274 


9.5 




310 


10.7 « 


5.7 


345 


11.5 


5.9 


650 


22.4 ' 


6.1 , 


. 326 


U ' 3 


- / 1 TOTAL' 


2,894 


100.0 



'^Students Whp^corad 8elow 



>' 2.1 
,?&2 
2.3 

- Z/A 



33c. ^ 

•2 , 

i 

, 21,^ 
:'2 

;/.-24, 



2.6-?*^: 2 
2.7"^ 4^ 



0.5 
0.1 

0.1 

•.p-:6 



f * - o 



3.0 <»v 76, /A&~'rp: / 

^5; ,r/m-!-" . 3 : ^' , ' •- ./ ' ; 
' 3;? /V'l'59' fj^4.1 7 - 



4.8 " 

5,0 

5.2 ' 

5.5 

5.7 % 

^.9 

6.1 



|47 
281';; 

2^7 
300 

304 * t 

'til 

278 
241 

7.00 

171 . 



TOTAL .3,912 



; 7.2 
0.0 
7.6 
7.7* 

: 

9 

7.1 . ' 
6-<2 
17.9/ 
' ,4,4 
1Q0C0 < 



^Sdores are expressed in grad'e equivalents .^he uniii' 
<of "measurement is one year; marfths are expressed Ss^ 
tenths of a unit. . ' 
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Appendix D 



STATISTICAL ADJUSTMENT OF PRE-TEST SCORES 
TO ACCOUNT FOR REGRESSION TO THE MEAN 



The equation used to adjust pre-test scores to account for the regression 
effect is taken fro, A.O.H. Roberts, "Regression Toward the Mean and the 
Regression Effect Bias" in Ne^ir^i^ Number ^ 

1980, (San Francisco, Jossey-Bass) , pages 59-82. T!>e equation is: 



-V Xcs = Xs + s 2 - P ) (Xg - Xs) 



•1 9 ft n °* ABr "' 1981 ^nlstratlon of the CaHfornia Achievement Test 

fylea'd i rig ) ;« Form D: 



* * 
3.0 5.0 



i}'^^* Grade 4 Grade 7 
% f^'sf ?° ted Pre " t6St mean 0f program Participants 

4; /' # ^C^^ff mean of P ro 9ra« participants 

£ /i-; ' • •, jff',^% v ^# mea » on pre-test*.* 4<8 ? g 

kgfc, V?^V#^ tati ° n ° f pre " test -ores nationally !.» 2 " 72 

W^*hl ^^^^-iation of pre-test scores citywide.. 1 63 2 37 

0.84 0.86 

Wi^J.* % \ ^ Ues 0 ^*\ computed on the following page. 

^t^^orM tfe^TW^ ^ diff6r s1 ^htly from 

fc,V^' ' ;/ ' V. .i ; 63 



Using the formula and values from the previous page, the computation 
of regression adjustment for Gates students tested in April, 1981 and 
January, 1982 is: 



Grade Four 

where Xs = 3.0; Xg = 4.8; cr = 1.99; s =1.63; and,p xx = .84 

1.99 2 

Xcs = 3.0 + 1.63 2 (1 - .84) (4.80 - 3.0) 
Xcs = 3.0 + (1.49) (1 - .84) (4.80 - 3.0) 
Xcs = 3.0 + (1.49) (.16) (1.8) 
Xcs = 3.0 + .429 
Xcs = 3.4 



Grade Seven 

where Xs = 5.0; Xg = 7.6; 0" = 2.72; s = 2.37; and, p xx = .86 

2.72 2 

Xcs = 5.0 + 2.37 2 (1 - .86) (7.6 - 5.0) 
Xcs = 5.0 + (1.317) (1 - .86) (7.6- 5.0) 
Xcs = 5.0 + (1.317) (.14) (2.6) 
Xcs = 5.0 + .479 
Xcs =5.5 
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